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Certainty Equivalence, Separation Principle, 
and Cooperative Output Regulation of 
Multi-Agent Systems by Distributed Observer 
Approach 


Jie Huang 


Abstract The cooperative output regulation problem of linear multi-agent systems 
was formulated and studied by the distributed observer approach in lISOllSTl . Since 
then, several variants and extensions have been proposed, and the technique of 
the distributed observer has also been applied to such problems as formation, ren¬ 
dezvous, flocking, etc. In this chapter, we will first present a more general formula¬ 
tion of the cooperative output regulation problem for linear multi-agent systems that 
includes some existing versions of the cooperative output regulation problem as spe¬ 
cial cases. Then, we will describe a more general distributed observer. Finally, we 
will simplify the proof of the main results by more explicitly utilizing the separation 
principle and the certainty equivalence principle. 


1 Introduction 

The cooperative output regulation problem by distributed observer approach was 
first studied for linear multi-agent systems subject to static communication topol¬ 
ogy in II20I . and then for linear multi-agent systems subject to dynamic communi¬ 
cation topology in f 2 T\ . The problem is interesting because its formulation includes 
the leader-following consensus, synchronization or formation as special cases. In 
contrast with the output regulation problem of a single linear system lEHSHU, the 
information of the exogenous signal may not be available for every subsystem due 
to the communication constraints. Thus, information sharing, or, what is the same, 
cooperation among different subsystems is essential in the design of the control law. 
We call a control law that satisfies the communication constraints as a distributed 
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control law. The core of the approach in 112011211 is the employment of the so-called 
distributed observer, which provides the estimation of the leader’s signal to each 
follower so that a distributed controller can be synthesized based on a purely de¬ 
centralized controller and the distributed observer. Such an approach to designing a 
distributed controller is known as the certainty equivalence principle. 

Since the publication of lllOllin . several variants and extensions of ll20ll2Tll have 
been proposed ifTH fTH [Thl [19] [25] . The objectives of this chapter are three folds. 
First, we will present a more general formulation of the cooperative output regu¬ 
lation problem for linear multi-agent systems that includes some existing versions 
of the cooperative output regulation problem as special cases. Second, we will de¬ 
scribe a more general distributed observer. Third, we will simplify the proof of the 
main results by more explicitly utilizing the separation principle and the certainty 
equivalence principle. 

The cooperative output regulation problem by the distributed observer approach 
can also be generalized to some nonlinear systems such as multiple Euler-Lagrange 
systems 12 and multiple rigid-body systems m . Moreover, the distributed observer 
approach can also be applied to such problem as the leader-following flocking / 
rendezvous with connectivity preservation EH- 

It should be noted that the cooperative output regulation problem of multi-agent 
systems can also be handled by the distributed internal model approach ll24l iTTll . 
This approach has an additional advantage that it can tolerate perturbations of the 
plant parameters, and it does not need to solve the regulator equations. A com¬ 
bined distributed internal model and distributed observer approach is proposed in 
m. Nevertheless, in this chapter, we will only focus on the distributed observer 
approach. 

Notation, g) denotes the Kronecker product of matrices. (7(A) denotes the spec¬ 
trum of a square matrix A. For matrices x,- € i= 1,... ,m, col(xi,... ,Xm) = 

[x^,... ,x^]^. We use a{t) to denote a piecewise constant switching signal a ; [0, -l-oo) 
—7 = {1,2,. ..,p} for some positive integer p where is called the switching 

index set. We assume the switching instants to = 0,fi ,f 2 , ■ ■ ■ of (7 satisfy 4+1 ~ 4 > 

T > 0 for some constant T and for any k >0, and T is called the dwell time. /„ 
denotes the identity matrix of dimension nhy n. 


2 Linear Output Regulation 

In this section, we review the linear output regulation problem for the class of linear 
time-invariant systems as follows; 


x{t) = Ax{t) + Bu{t) + Ev{t), x(0)=xo, f > 0, 
ym{t) = C,nx{t) + D,„u{t) + F„v{t), 
e(t) = Cx{t) +Dii{t) +Fv{t), 


(1) 
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where ;ic S M", y,n G K.'’"', e € and u G ffi."’ are the state, measurement output, error 
output, and input of the plant, and v G is the exogenous signal generated by an 
exosystem of the following form 

i>(f) = 5v(f), v(0) = Vo, t > 0, (2) 

where S is some constant matrix. 

Typically, the tracking error e is the difference between the system output y and 
the reference input r, i.e., e =y — r where y = Cx+Du+Fiv for some matrix Fi and 
r = F 2 V for some matrix Fj. Thus, in ([T]i, we have F =Fi—F 2 . The tracking error e is 
assumed to be measurable, but it may not be the only measurable variable available 
for feedback control. Using the measurement output feedback control allows us to 
solve the output regulation problem for some systems which cannot be solved by 
the error output feedback control. 

For convenience, we put the plant ([TJ and the exosystem (|2]i together into the 
following form 


x = Ax + Bu+Ev, 

V = Sv, 

(3) 

ym — F DffiU -)- Ffl^V, 

e = Cx + Du + Fv, 

and call (|3ll a composite system with col(x, v) as the composite state. 

In general, some components of the exogenous signal v, say, the reference inputs 
are measurable and some other components of the exogenous signal v, say, the un¬ 
known external disturbances are not measurable. Denote the unmeasured and mea¬ 
sured components of v by v„ G K.^" and Vm G W"' , respectively, where 0 <qu, qm < q 
with qi, + qm = q. Then, without loss of generality, we can assume v„ and v,n are gen¬ 
erated, respectively, by the following systems: 

Th — Vm — SmVm^ (4) 

for some constant matrices and Sm- @ is still in the form of (|2]i with v = 
col(v„,Vm) and 5 = block diag[5„,5m]. 

To emphasize that v may contain both measurable and unmeasurable compo¬ 
nents, we can rewrite the plant ([TJ as 

x{t) =Ax{t)+Bu{t)+EuVu{t)FEmVm{t), x(0)=xo, f>0, 

ym{f ) — CmX(t ) -f- DmU{t ) -f FmuVui ^) DmmVmi .^), (5) 

e(t) = Cx{t)+Du{t)+FuVu{t)+FmVm{t). 

where E = [£„ £„,], Pm = [Fmu Pmm], and F = [F„ Fm]- 

We will consider the following so-called measurement output feedback control 
law: 
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u^K^Z + Kyym, 

i = ‘S\z + ^iym, 

where z G R"= with to be specified later, and /Q £ Ky £ £ 

^2 G R'^^^P'" are constant matrices. 

This control law contains the following four types of control laws as special 
cases. 

1. Full information when = col(x, v) and = 0: 

u = Kix + K2V, (7) 

where Ki £ R'”^" and K 2 £ R'”^^ are constant matrices. 

2. (Strictly proper) Measurement output feedback when Ky = 0: 


u = K^z, 

Z = ‘S\Z + ^2ym- 

3. Error output feedback when ym= e and Ky = 0; 

u = K^z, 

z = ^\z + ^ 2 e- 


(8) 


(9) 


4. Combined error feedback and feedforward when y^ = col(e, v'): 


u = K{z + KvV, 
z = '^\z + ‘See + 


( 10 ) 


where Ky = [0mxp,Kv\, and ^2 = [%,%]■ 

Needless to say that the control law (|6ll contains cases other than the control laws 
© to (doll. 

From the second equation of the plant © and the first equation of the control law 
©, the control input ii satisfies 

It = K^Z ~\~ KyiCffiX ~h Dfn^^ H” ; 


or 


{I„,-KyDm)u = KyCmX + K^z + KyF„,v. (11) 

Therefore, the control law (|6]l is well defined if and only if Im—KyD,n is nonsingular. 
It can be easily verified that the four control laws © to (fTOl i all satisfy KyD^ = 
0. Thus, in what follows, we will assume KyD,n = 0 though it suffices to assume 
Im — KyD,„ is nonsingular. As a result, we have 

u = KyC„,x + KyZ + KyF,nV. 


( 12 ) 
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Under the assumption that KyD,n = 0, the control law (|6]l can be put as follows: 

U = KyCmX + K.Z + KyFm V, 

Z = {^2{C,n+D„,KyC,n))x+ (^1 + 

Thus, the closed-loop system composed of the plant ([T]i and the control law (|6]l 
can be put as follows: 

Xc — ^cXc 

(14) 

e = CcXc + DcV, 

where Xc = col(x,z), and 

, _ £ + BKyFm 

[^2{Fn,+Dn,KyFr„)\ ’ 

Cc = [C DKyCfit DK^] , Dc = F F DKyF„j. 

In particular, for the full information control law (I?]), we have = col(jc, v) and 
Uj = 0. Thus, Xc = X, KyCtn = Ki, KyFm = £ 2 - As a result, we have 

Ac=A+BK^, Bc=E + BK 2 , 

Cc = C + DKi, Dc=F + DK2. 


A T BKyCtn BK^ 

^ ^ ^2{Cm+DmKyC,n) ^1 +^2D,nK, 


We now describe the linear output regulation problem as follows. 

Problem 1 Given the plant O and the exosystem 0, find the control law of the 
form m such that the closed-loop system has the following properties. 

• Property 1: The matrix Ac is Hurwitz, i.e., all the eigenvalues of Ac have negative 
real parts; 

• Property 2: For any Xc(0) and v'(0), lim e{t) = 0. 

At the outset, we list some standard assumptions needed for solving Problem[T] 


Assumption 1 S has no eigenvalues with negative real parts. 
Assumption 2 The pair {A,B) is stabilizable. 


Assumption 3 


The pair 



A£„]\ 

0 


is detectable. 


Assumption 4 The following linear equations 


XS = AXFBU + E, 
Q = CXFDU + Ft 


admit a solution pair (A,t/). 
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Remark 1 Assumption^is made so that Property 1, that is, the exponential stabil¬ 
ity of Ac, can be achieved by the state feedback control. Assumption^together with 
Assumption^is to render the exponential stability ofA^ by the measurement output 
feedback control. Assumption\I]is made only for convenience and loses no gener¬ 
ality. In fact, if Assumption\I\is violated, then, without loss of generality, we can 
assume S = block diag [5i,52] where satisfies Assumption\J] and all the eigen¬ 
values of S 2 have negative real parts. Thus, if a control law of the form solves 
Problem 1 with the exosystem being given by v\ = 5ivi, then the same control law 
solves Problem 1 with the original exosystem v = Sv. This is because Property 1 is 
guaranteed by Assumption^and /or Assumptions^ and, as long as the closed-loop 
system has Property 1, Property 2 will not be affected by exogenous signals that 
exponentially decay to zero. 

Remark 2 Equations ( 1751) are known as the regulator equations It will be 
shown in Theorem^and Remark^that, under Assumptions\J]to^ Problem\J]is 
solvable by a control law of the form m only if the regulator equations are solv¬ 
able. Moreover, if Problem [7] is solvable at all, necessarily, the trajectory of the 
closed-loop system starting from any initial condition is such that 


lim( 2 c(f) —= 0 and lim(i/(f) — t/v(f)) = 0. 

t^oo ?—>-oo 


(16) 


Therefore, Xv and Uv are the steady-state state and the steady-state input of the 
closed-loop system signal at which the tracking error e is identically zero. Thus, the 
steady state behavior of the closed-loop system is completely characterized by the 
solution of the regulator equations. 

Remark 3 By Theorem 1.9 of 4701/ . for any matrices E and F, the regulator equa¬ 
tions (Ha are solvable if and only if 


rank 


A-XI B 
C D 


— n-\-p, V X e C7{S). 


(17) 


Nevertheless, for a particular pair of [E ,F), the regulator equations may still have 
a solution even if (117b fails. 


3 Solvability of the Linear Output Regulation Problem 

In this section, we will study the solvability of Problem [T] Let us first present the 
following lemma on the closed-loop system. 

Lemma 1 Suppose, under the control law the closed-loop system ( 174b satisfies 
Property 1, i.e., Ac is Hurwitz. Then, the closed-loop system m also satisfies Prop¬ 
erty 2, that is, \\m,^aoe{t) = 0, if there exists a matrix Xc that satisfies the following 
matrix equations: 
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X,.S = AcXc + Bc, 

(lo) 

0 = CcXc+Dc. 

Moreover, under the additional Assumption\J] the closed-loop system ( 1741) also sat¬ 
isfies Property 2 only if there exists a unique matrix X^ that satisfies ( I7(SD . 

Remark 4 The proof is the same as that of Lemma 1.4 of 4701/ . and is omitted. Here 
we only note that, ifXc satisfies m, then the variable x = Xc— XcV satisfies 

X = AcX, 
e = CcX. 


Since Ac is Hurwitz, \i'ra.t^oox{t) = 0, and hence, lim(-).oo e(f) = 0. Since the solvabil¬ 
ity of the first equation of (O is guaranteed as long as the eigenvalues of Ac do not 
coincide with those ofS. Thus, Assumption\J}is not necessary for the sufficient part 
of Lemma \I\ It suffices to require that the eigenvalues of Ac do not coincide with 
those of S. 

Lemma 2 Under Assumption\J\ suppose there exists a control law of the form 
such that Property 1 holds. Then, Property 2 also holds if and only if there exist 
matrices X and U that satisfy the regulator equations 

XS=AXPBU + E, 

(19) 

Q = CX+DU + F. 

The proof is similar to that of Lemma 1 . 13 of uni and is thus omitted. 

Now let us first consider the full information case where the control law is defined 
by two constant matrices K\ and K 2 . The two matrices K\ and K 2 will be called the 
feedback gain and the feedforward gain, respectively. 

Theorem 1 Under Assumption^ let the feedback gain Ki be such that [A XBK{) 
is Hurwitz. Then, Problem 1 is solvable by the full information control law 0 if 
Assumption^holds and the feedforward gain K 2 is given by 


K2 = U-KiX. ( 20 ) 

Proof. Under Assumption |2] there exists K\ such that Ac = A -\-BK\ is Hurwitz. 
Thus, under the control law ©, Property 1 is satisfied. Under Assumption |4] let 
x=x — Xv and K 2 be given by (l20l i. Then we have 

X = (A + BK\ )x, 

( 21 ) 

e={C + DKi)x. 

Since (A 4-BKi) is Hurwitz, x(f) and hence e{t) will approach zero as t tends to 
infinity. Thus, Property 2 is also satisfied. 

Remark 5 By Lejnma\^ Assumption^is also necessary for the solvability of Prob¬ 
lem 1 by the full information control law 0 if Assumption\I\also holds. 
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We now turn to the construction of the measurement output feedback control law 
Since we have already known how to synthesize a full information control law 
which takes the plant state x and the exosystem state v as its inputs, naturally, we 
seek to synthesize a measurement output feedback control law by estimating the 
state X and the unmeasurable exogenous signal v„. To this end, lump the state x and 
the unmeasured exogenous signals Vu together to obtain the following system: 


X 


A Eu 


X 


B 


Em 

Vu 

— 

0 Su 


Vu 

+ 

0 

u ~\- 

0 


ym — [Cm ^mu\ 


-f Dffili -f Fjyi 


( 22 ) 


Employing the well known Luenberger observer theory suggests the following ob¬ 
server based control law: 

U= [A"i K2u\z~\~ K.2tnVm’, 

._\AEu 

^ 0 Su 


z + 


Ejn 

0 


^mFE{y^ [Cfn Effjii FffiffiVffi')^ 


(23) 


where K 2 u € K 2 m G and L G is an observer gain matrix. 

The control law (l23t can be put in the following form 


U — K^Z “f ^2mt^m; 

Z = ^lZ + %iym+ ^22 Vm, 


where 


K, = [Ki K2 u 
'AE u 
0 Su 

= L, 


/Q — L( [ C,n F,nii ] + DmKy) , 


K2n 


Em 

0 


— E{F mm F E) 

m K 2 m)- 


Since Vm is measurable, there exists a matrix C^, such that v,,, = Cyym- Thus the 
control law (l24l i can be further put into the standard form (|6]l with Ky = K 2 mCv and 
^2 = ^21 +^^22Cv 

Theorem 2 Under Assumptions^and^ Problem 1 is solvable by the measurement 
output feedback control law dS]) if Assumption^holds. 

Proof First note that, by Assumption |2] there exists a state feedback gain Ki such 
that (A +BKi) is Hurwitz, and, by Assumption [2 there exist matrices Li and L 2 
such that 


Al 


'AEu 


'Ll' 

0 Su 


L 2 


\ Cm Emu ] 


A L\Cm Eu E\Fmii 
E2Cm Su E2Fmu 
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is Hurwitz. Let {X,U) satisfy the regulator equations, L 
U — KiX, and partition Ki as K 2 = [^ 2 u)^ 2 m]- Let x = (x- 


Ze = 


X 

Vu 


— z- Then, it can be verified that 


= co 1 (Li,L 2 ), and K 2 = 
Xv), u = {u — Uv), and 


ii 


[^1,^2,,] 


X^Ze “f X2ynVfn UV 


-K,Ze + Kix + K2V - {K2 + KiX)v 


—K^Ze + Kix. 


In terms of x and Ze, the closed-loop system is given by 

X = Ax + Bu = (A + BKi )x — BK^Ze, 
Ze =ALZe- 


(25) 


Let Ac be the closed-loop system matrix. Then (j{Ac) = (j{A+BKi) U (J{Al). Thus 
Property 1 is satisfied. To show lim;^a,e(f) = 0, first note that (l25T l implies that 
limf^oof(f) = 0 and \im.t^ocZe(t) = 0. Then note that e = Cx+Du +Fv = Cix — 
Xv) + D{u - Uv) + (CX +DU+ F)v = C(x -Xv)+D(u- Uv) = {C + DK^ )x - 
DK,Ze. 

Remark 6 By Lejnma\^ Assumption^is also necessary for the solvability of Prob¬ 
lem 1 by a measurement output feedback control law of the form (0 if Assumption 
\I\also holds. 

Specializing (l24l i to the two special cases with v = v„ and v = v^, respectively, 
gives the following two corollaries of Theorem |2] 

Corollary 1 Under Assumptions^to^with Vu = v. Problem 1 is solvable by the 
following observer based control law: 

u = [Ki K 2 ]z, 

. 'AE 


u-\~E{ym [C//I Ffi^z Djnu).) 


(26) 


where L is an obser\’er gain matrix of dimension [n -\-q) by p„,. 

Corollary 2 Under Assumptions^to^with v^ = v, Problem 1 is solvable by the 
following observer based control law: 


U = KiZ-\-K2V, 

z=Az-\-Bu-\-Ev-\-L{y„, — CmZ — FmV — Dmu), 
where L is an observer gain matrix of dimension n by pm- 


(27) 
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4 Linear multi-agent systems and distributed observer 


In this section, we turn to the cooperative output regulation problem for a group of 
linear systems as follows: 

Xi =AiXi + BiUi+EiV, 

ymi — CfniXi -f Dyni^i “f FyyiiVj (28) 

Ci = Qxi + DiUi +FiV, 

where xi € M"', ymi € R'’"”', e,- € R''' and «,■ G R'"' are the state, measurement output, 
error output, and input of the /th subsystem, and v G R^ is the exogenous signal 
generated by a so-called exosystem as follows 


V = Sv, y,n 0 = Cqv, (29) 

where y,„o G R^” is the output of the exosystem. 

Like the special case with = 1, the exogenous signal v may also contain 
both unmeasured components v„ G R‘^“ and measured components Vm G R'^'", where 
0 < qu,qm < q with qi, + qm = q. Then, like in ([Til, we can assume Vu and Vm are 
generated by dUi. Correspondingly, we assume Co = [Opox< 7 „,Cmo] for some matrix 
CmO G As a result, the plant (i28T l can be further written as follows. 

Xj = AiXj -f BjUi -f EjifVii -f Eim^mj 

ymi — CmiXi -f Dmi^i “b Fmiu^u “b B'mim'^m^ (30) 

Ci = CiXi -f- DiUi H- Fiu^u F Fimymt ^ ~ 1 ; ■ ■ ■ 


where Ej — [Efu Fj^^j — 

[Ffniit F/nim ], and Fi = [Fu, Fm,]. 

Various assumptions are as follows. 

Assumption 5 S has no eigenvalues with negative real parts. 

Assumption 6 For i = 1 ,... ,N, the pairs {Ai,Bi) are stabilizable. 


Assumption 7 For i= 1 ,..., V, the pairs |^[C„ij Pmu,] 
Assumption 8 The linear matrix equations 


Ai 

0 Su\) 


are detectable. 


XiS = AiXi+BiUi+Ei 
0 = CiXi+DiUi + Fi 


(31) 


have solution pairs {Xi,Ui). 

Remark 7 The system ( 12(St is still in the form ofm with X = col(x\ ,... ,xa^), u = 
col(u\,... ,un), ym = colijmx ,... ,ymN), e = col{e\,... ,eiv). Thus, if the state v of 
the exosystem can be used by the control Ui of each follower, then, by Theorem\J\ 
under Assumptions^and^ the output regulation problem of the system ( l2iSI ) and 
the exosystem ( l29l ) can be solved by the following full information control law: 
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Ui = KiiXi + K2i\\ i=\,...,N, 


(32) 


where K\i, i = 1,...,A^, are such that Aj + BiKu are Hurwitz, and K 2 i = Ui — K\iXi. 
Under the additional Assumption^ there exist Li S such that 


Ai Eiu 
0 Su 


Li [ Cfni j 


are Hurwitz. Partition K 2 i as K 2 i = [K 2 iu,K 2 im] with 7^2,■„ € 7^2, 

Then, by Theorem]2\ under Assumptions^to\^ the output regulation problem of the 
system Ii28\l and the exosystem ( 1291) can be solved by the following measurement 
output feedback control law: 


Ui — \H\_i H2iu\Zi ~\~ K2i}n^m^ i — 


Zi = 


Ai Eiu 
0 Su 


Zi- 


Eim 

0 


Vm 




(33) 


Nevertheless, in practice, the communication among different subsystems of 
(1281) is subject to some constraints due to, say, the physical distance among these 
subsystems. Thus, the exogenous signal v or the measurable exogenous signal 
v,n may not be available for the control m, of all the followers. Since, typically, 
Ci = yi — yo, the tracking error e, may not be available for the control m, of all 
the followers. To describe the communication constraints among various subsys¬ 
tems, we view the system (l28T l and the system ( l29b as a multi-agent system with 
( l29b as the leader and the N subsystems of (l28l l as the followers, respectively. Let 
%it) = with y = {0,1,...,N} and C r x ^ for all f > 0 be a 

switching graph, where the node 0 is associated with the leader system ( |29] | and 
the node i, / = 1,...,N, is associated with the ith subsystem of the system ( l28l l. For 
i = 0,1,... ,N, j = 1,...,N, {i,j) € if and only if uj can use y,„i for control at 
time instant t. Let = {j \ {j,i) G denote the neighbor set of agent i at 

time instant t. 

The case where the network topology is static can be viewed as a special case 
of switching network topology when the switching index set contains only one ele¬ 
ment. We will use the simplified notation ^ to denote a static graph. 

We will consider the following class of control laws. 

Ui = f{xi,^i), i=l,...,N, 

(34) 

where both f and gi are linear in their argument, and g, is time-varying if the graph 
^ 0(0 is- It can be seen that, at each time f > 0, for any i = 1,... ,N, Ui can make 
use of y„,o if and only if the leader is a neighbor of the subsystem i. Such a con¬ 
trol law is called a distributed control law. If, for i = 1,... ,N, f is independent 

* See Appendix for a summary of graph. 
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of Xi, then the control law is called a distributed measurement output feedback 
control law. If, for i = 1, ... ,N, = {0}, V f > 0 , then the control law (|S4] | is 

called a purely decentraUzed control law. In particular, ( |3^ and (|33] | are called the 
purely decentralized full information control law, and the purely decentralized 
measnrement output feedback control law. 

We now describe our problem as follows. 

Problem 2 Given the systems ^2iSI >. i\29\l and a switching graph fi^d a dis¬ 
tributed control law of the form ( 1541 ) such that the closed-loop system has the fol¬ 
lowing properties: 

• Property 1: The origin of the closed-loop system with v being set to zero is asymp¬ 
totically stable. 

• Property 2: For any initial condition x,(0), ^((O), i = 1,... ^N, and v(0), the so¬ 
lution of the closed-loop system is such that 

lime,(f)=0, /=1,...,A^. (35) 

t—foo 

Clearly, the solvability of the above problem not only depends on the dynamics of 
the systems ( |28] ), ( l29l l, but also the property of the graph ^ typical assumption 
on the graph ^a{t) follows. 

Assumption 9 There exists a subsequence {4} o/ji: i = 0,1,.. .} with < 

V for some positive V such that every node i = 1,... ii reachable from the node 
0 in the union graph 

Remark 8 Assumption^is similar to what was proposed in 472117^11271/ . and will 
be called jointly connected condition in the sequel. Since, under Assumption^ the 
graph ^a{t) disconnected for all t >0, it is perhaps the least stringent condi¬ 

tion on the graph as opposed to some other conditions such as every time connected, 
or frequently connected. In particular, Assumption^is satisfied if Assumption 2 of 
is. Thus the main result in Ms is essentially included in EB even though the 
approach in M6’i appears somehow different from that in 4271/ . 

The static graph is a special case of the switching graph when p = 1. For this 
special case, Assumption|9]reduces to the following. 

Assumption 10 Every node i = I,... ,N is reachable from the node 0 in the static 
graph . 

Remark 9 Let = ifV denote the subgraph of where f' = {!,... ,N}, 
and ^o-(r) G Y y. f' is obtained from by removing all edges between the 

node 0 and the nodes in Y. Let £^a{t) = Wij{f)]fj=o denote the weighted adja¬ 
cency matrix of Laplacian matrix of ^a{t) = 

diag{aiQ{t),...,ai\iQ{t)). Then, it is shown in Remark 14 of KITH that, under Assump¬ 
tion^ the matrix 77cj{;) = -^aj) +^<T(f) ihe property that all the eigenvalues of 

the matrix T!j=ii. ' ^a{j) have positive real parts. Furthermore, if the graph ^a(t) 
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is undirected, then the matrix positive definite. In particular, under 

Assumption\T^ the constant matrix —H is Hiirwitz. 


5 Some Stability Results 

As pointed out in Introduction, our approach is based on the employment of the 
distributed observer. To introduce the distributed observer. Let us first consider the 
stability property for the following class of switched linear systems: 

x{t) = {In®A- iiF^(,)®{BK))x{t), a{t)G^, (36) 

where A G B G and G are given, and p> 0 and K G R'"^" 

are to be designed. 

Assumption 11 There exists a subsequence {4} of{i : i = 0,1,...} with — ti^ < 

V for some positive V such that all the eigenvalues of the matrix ^ ^o(i) have 

positive real parts. 

The stability property of the system of the form (l36l l has been extensively studied 
in the literature. We summarize the main results in two lemmas corresponding to the 
switching network and the static network, respectively, as follows. 

Lemma 3 Under Assumption\T7] suppose the pair (A,B) is controllable. Then, 

(i) If A is marginally stable, i.e., there exists a unique positive definite matrix P 
such that PA +A^P < 0, and Fa{t) symmetric, then, with p = 1, and K = B^P, 
m is asymptotically stable; 

(ii) If B = I„ and A has no eigenvalues with positive real parts, then, with any 
p > 0, and K = I„, ( 1561 ) is asymptotically stable. 

Remark 10 The stability property of the system of the form ( 1361 ) was first studied in 
MIV . Part (i) of Lemma\^was established in Theorem 1 of l\22]I . Part (ii) of Lemma 
|3]wfls established in Lemma 2 of l[21\l . As a corollary of Lemma 2 of l[21\l . under 
Assumption\T]\ for any p > 0, the following system 

X = -pFa{,)X (37) 

is asymptotically stable. Ai a special case of this result, when = {1}, the matrix 
F(y(t) is constant 1 1771/ . and will be denoted by F. For this special case, the result of 
Lemma^can be strengthened to the following. 

Lemma 4 Under Assumption\lJ]with 7?^ = {!}, suppose the pair {A,B) is stabiliz- 
able. Then, 

(i) Let P be the unique positive definite matrix satisfying PA +A^P — PBB^P + 
In < 0, andp>5^^ where 5 = min{7?e(A,(7^)}. Then, with K = B^P, ( l36l ) is asymp¬ 
totically stable; 


14 


Jie Huang 


(ii) If B = /„, then, for any A, f l36| ) is asymptotically stable with K = /„, and 
sufficiently large p. 

Remark 11 The proof of Part (i) of Lemma^can be extracted from the proof of 
Theorem 2 of H24\l . In fact, under Assumption\lj\with = {\}, all the eigenvalues 

of F have positive real part. Let T be such that TFT^^ = J is in the Jordan form 
of F. Denote the eigenvalues of F by Then [I^ ® A) ~ p(F ® BK) = 

®In){{lN — p{J® BK)){T ®In)- From the block triangular structure of 
J, we know that the eigenvalues of (8) A) — p{F i^) BK) coincide with those of 
A — pXiBK, i = 1,... ,N. Since the pair {A,B) is controllable, by Lemma 1 of l\26\l , 
the algebraic Riccati equation 

A^P + PA-PBB'^P + I„ = Q (38) 

admits a unique positive definite solution P. Moreover, for any > 5^* where 5 = 
min{/?e(A, (F)}, the gain matrix K = B^P is such that A — pXjBK and hence {In ® 
A) — p{F BK) are Hurwitz- 

Part (ii) of Lemma^was established in Theorem 1 of i l2QI/ . It is also a direct 
result of the fact that the eigenvalues of the matrix {In <8 A) — /i(F(8/n) are 

{Xi{A) - pXj{F) : i= j = 

where XfA) and Xj{F) are the eigenvalues of A andF, respectively. Thus, the matrix 
{In'^A) — p{F iSi In) is Hurwitz for sufficiently large p, and is Hurwitz for any 
positive p if A does not have any eigenvalue with positive real part. 


6 Solvability of the Cooperative Linear Output Regulation 
Problem 


Given systems (l28T l. (|2^ and the switching graph whose weighted adjacency 
matrix is denoted by = [ai 7 ( 0 ]f';= 0 ’ following compensator 

Pi = SmPi + Y. ‘^ijif)Cmo{Pj - t],) , * = 1, ■ ■ ■ ,(39) 

where po = Vm, p > 0 and Lq S are two design parameters, a distributed 

observer candidate for v,,,, and call it a distributed observer for Vm if, for any Vm(0) 
and Pi{Q), i= 1,...,N, 


\im{pi{t)-Vm{t))=0, i=l,...,N. (40) 

Whether or not ( |39] | is a distributed observer of Vm depends on both the pair 
{CmO,Sm) and the property of the graph. 
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Let 77 , = {rji — Vm), and 77 = col( 77 i,..., fjN). Then, the system (1^ can be put in 
the following compact form 

r) = {{In ^ Sm) - li{Ha{t) ® LoCmO))fl. (41) 

Thus, the system (|39] | is a distributed observer of v„, if and only if the system (l4Tl i 
is asymptotically stable. 

Remark 12 Since {{lN<S)Sm)-®LQC,nQ)f = {In®SI,)- 

system m is asymptotically stable if and only if a system of the form t l36l ) with 

A = Sjjj, ^ ~ ^ ~ ^1) asymptotically stable. Moreover, by 

Remark^ under Assumption^ all the eigenvalues of the matrix hove 

positive real parts. Furthermore, if the graph undirected, then the matrix 

'^‘j=L ^ positive definite. 

Corresponding to the two purely decentralized control laws (1321) and (l33T l. we can 
synthesize two types of distributed control laws as follows; 

1. Distributed full information control law: 

Hi = KiiXi + K2ir\i, i=\,...,N, 
f]i = Srii + E ^uit)Co{rij - rji) 



where ITi/ S are such that A, are Hurwitz, K 2 i = Ui — KuXi, p is some 

positive constant, and rjo = v = v,„. 

2. Distributed measurement output feedback control law: 


Ui — [K\i K2iii\zi + ^2iml7i: ^ ^ ; ■ ■ ■ 



'A, 

Eiu 


Bi' 


^itn 

Zi = 

0 

Su_ 

Zi + 

0 

Ui + 

0 


F Fjiymi [Cnti Fmiu^Zi DyniUi FfjiiniTjif ( 43 ) 

Pi = S„,rii + )tLo E ‘^u{f)Cmo{rij - ifi) , 


where 770 = Vm. 

Remark 13 The control law i l42l ) contains the distributed state feedback control law 
in sm as a special case by letting Lq = Co = Iq, or what is the same, y,„o = v, and 
the control law ( 1431 ) contains the distributed measurement output feedback control 
law in ally as a special case by letting Vm = v, and Lq = C„,o = Iq- 

Remark 14 Both of the control laws ( 1421 ) and ( 1431 ) are synthesized based on the 
certainty equivalence principle in the sense that they are obtained from the purely 
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decentralized control laws and ( 1331 ) by replacing v in ( 1321 ) and in ( 1331 ) with 
rji, respectively, where rji is generated by a distributed observer of the form ( 1391 ). 

In 1201 and ED, the solvability of the cooperative output regulation problem was 
established by means of Lemma [D which incurred tedious matrix manipulation. In 
what follows, we will further simplify the proof of the solvability of the problem by 
means of the following Lemmas. 

Lemma 5 Consider the linear time-invariant system 

X = Ax-\-Bu, t >0, (44) 

where x € R”, A € is Hurwitz, and u G K™ is piecewise continuous in t and 
lim,_>oo u{t) = 0. Then, for any initial condition x(0), lim,_>oo A:(f) = 0. 

Proof The conclusion follows directly from the fact that the system (l44l i is input- 
to-state stable with the input u decays to the origin asymptotically (Example 2.14 of 
HI). A more elementary self-contained proof can be given as follows. For any .x(O), 
let 


x{T)=e^'^x{Q)+ r e^^'^-''^Bu{T)dT, T>Q. 
Jo 


(45) 


and 


xf) = e^^^-^^x{T) + J‘ e^^‘-^'>Bu{T)dT, t > T. (46) 

It suffices to show lim,_i.„ox(f) = 0. Since A is Hurwitz, we have < 

for some k>0 and A > 0. Thus, for any T >0, lim,_j.oo = 0. 

We only need to show that, for sufficiently large T, lim(_!.oo \ \ Bu{'i)dx\ \ = 

0. In fact, for any t>T, 


f e^^*-^'^Bu{T)dT < r/te-^('-")||B||||M(T)||£/T 
Jt Jt 


<H sup ||m(t)||(1-.-"('-^)) 
^ r<T<! 

,, . M, 

< sup ||m(t)||. 

^ T<t<t 


(47) 


Since lim,^* u{t) = 0, for any £ > 0, there exists T > 0, such that, for any t >T, 
||M(f)ll ^ *03 implies 


j ’°'>Bu{x)dx 


(48) 


Thus, limf-).oox(f) = 0. 
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Lemma 6 Under Assumption [7] suppose a control law of the form @ solves the 
output regulation problem of the system di]). Let : [0,°°) —7 IR."’ and 5z '■ [0,°°) —>■ 
K"= be two piecewise continuous time functions such that lim;_>.oo 5«(f) = 0, and 
limf->oo Sv{t) = 0. Then the following control law 

u = KzZ + Kyy,fi + 5„(f), 

Z = ^\Z + ^lym + 5z(f), 


is such that Yimt^oocf) = 0 . 

Proof Denote the closed-loop system composed of Q and (| 6 ]l by (fT4l i. Then, Ac is 
Hurwitz. By Lemma[T] there exists a unique matrix Xc that satisfies equation (fTSl l. 
Let Xc{t) = Xc{t) —Xcv{t). Then the closed-loop system composed of Q and ( |49] | 
satisfies 


Xc — AcXc -f BuSii (t) “f Pz^z )5 

e = CcXc + Ddu{t), 

where = col(B,^^ 2 Dm) and Bz = col(0„xnj,4j)- 

By Lemma|5] we have Ym\t^ooXc{t) = 0, and, thus, lim,^«,e(f) = 0. 

From the proof of Lemma |6] we can immediately obtain the following result. 

Corollary 3 Under Assumption [7] suppose a control law of the form (|6ll solves 
Problem 1. Let S^{t) be a piecewise continuous square matrix defined over [0,°°) 
such that fj = S^{t)ri is asymptotically stable, and Ku and Kz be any constant ma¬ 
trices. Then, under the following control law 

U = KzZ “f Xyyyyi “f TJ , 

z = ifiz-Yif2ym+Kzri, (50) 

fi=y'(t)7], 

the closed-loop system also satisfies the two properties in Problem 1. 

We now consider the solvability of Problem 2. 

Lemma 7 Suppose the distributed observer (1411 is asymptotically stable. Then, 

(i) Under Assumptions\^^\^ Problem 2 is solved by the distributed full infor¬ 
mation control law dUll; 

(ii) Under the additional Assumption^ Problem 2 is solved by the distributed 
measurement output feedback control law ( 1451 . 

Proof. Part (i) Let Ku G be such that A; + Z?,Wi,' are Hurwitz, and K 2 i = Ui — 

KiiXi, i = 1,... ,N. Then, by Remark |7] the purely decentralized full information 
control law ( l32l i solves Problem 2. Since the control law (1421) can be put in the 
following form: 
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Ui = Kuxi + K2iV + K2if\i, i=\,...,N, 
f) = {{lN<S)S)-fi{H„^t)<^LoCo)) fj, 

where lim,^oo fl{t) =0. By Corollary[3 the proof is complete. 

Part (ii) Under the additional Assumption |7] there exist L,- € such 

that 


Au 


Ai Eiu 
0 Su 


Ej [ Cmi Ffjiiii j 


i=h...,N, 


are Hurwitz. By Remark |7] Problem 2 can be solved by a control law of the form 
(l33l). Now denote the control law (l33]l by = kj{zi , Vm ),Zi = gi{zi, ki{zi,Vm),ymi,Vm), 
i= and the control law (|4^ by 


Ui = ki{zi,r]i), /=l,...,At, 

i-i = t?(); (52) 

t? — ((^A^ 5m) ft ® EqCh^q^^ fj. 

Then it is ready to verify that 


ki(Zij TJij — kjizi^ fji “f Vm) — Vm) “t" E2imfjiy (53) 


and 


gi(Zi,ki(zi, T]i),ymi-i 'Hi) 

— gii^i 7 ^i{j-i7 ^’nt) T E2imfji7ymi7 fji “t” t’m) 

~ gi{g.i7^iig-i7^mj 7ymi7^’mj + Eifji^ (54) 


where 


ri = 


K2i, 


Ei {Emim “f ) • 


Since lim,^„ 77 , (t) = 0 for i= 1,..., A, the proof follows from Corollary [3 


Remark 15 Lemma^is the reminiscent of the well known separation principle for 
the design of the Luenberger observer based output feedback control law. What is 
worth noting is that the closed-loop system is a time-varying system when the graph 
is a switching graph. 

Combining Lemma|7]with Lemmas |3] and |4] respectively, leads to the following 
two theorems. 


Theorems Suppose Assumption^holds. Then, 

(i) if the graph ts undirected, the pair (Co, 5) is observable, and S is marginally 

stable, then, under Assumptions | 6 ] and 0 Problem 2 is solved by the distributed 
full information control law (l42l) with ft = 1 and Lq = PCq where P is the unique 
positive definite solution of the inequality PS^ SP <0, and, under the additional 
Assumption^ Problem 2 is solved by the distributed measurement output feedback 
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control law m with 11 = 1 and Lq = PCJ^q where P is the unique positive definite 
solution of the inequality PS]^ + SmP < 0; 

(ii) ify„,o = V, and none of the eigenvalues ofS has positive real part, then, under 
Assumptions^and^ Problem 2 is solved by the distributed full information control 
law t l42D for any jl > 0 and Lq = Iq; and 

(Hi) ifymO = I'm, and none of the eigenvalues of Sm has positive real part, then, 
under Assumptions^to^ Problem 2 is solved by the distributed dynamic measure¬ 
ment output feedback control law (EiJ/or any p. > 0 and Lq = Iq,„. 

Theorem 4 Suppose Assumption\rO\holds. Let 5 = min{/?e(A, ■(//)}. Then, 

(i) if the pair (Co,5) is detectable, then, under Assumptions\^^and^ Problem 
2 is solved by the distributed full information control law i42l with p > 8^^ and 
Lq = PCq where P is the unique positive definite solution of the inequality PS^ + 
SP-PClCQP+Iq < 0, and, under the additional Assumption^ Problem 2 is solved 
by the distributed measurement output feedback control law ( 1431 ) with p > 8^^ and 
Lq = PC^jQ where P is the unique positive definite solution of the inequality PS^^ + 
SmP ~ PC^joCmoP + ^ 0 ; 

(ii) ifymO = V, then, under Assumptions\^^and\^ Problem 2 is solved by the 
distributed full information control law (1421) for sufficiently large p, and Lq = Iq; 
and 

(Hi) ifymO = I'm, then, under Assumptions to ^ Problem 2 is solved by the 
distributed measurement output feedback control law ( 1431 ) for sufficiently large p 
and Lq = Iq„,. 

Remark 16 In Parts (ii) and (Hi) of Theorem^ if none of the eigenvalues of S or 
Sm has positive real part, then p can be any positive real number. 

Remark 17 For the case where v = Vm, the control law ( 1431 ) reduces to the following 
special form 


Ui — K\iZi “L KziVji, i — 1,...,A^, 

Zi = AiZi 3 ” BiUi EiVji A- Li(ymi CmiZi L)miUi Fmit]i ), 

rii = Spi + ^Lo Y. aij{t)Co{pj - Pi) , 


(55) 


where L; € are such that (A; — LiCmi) are Hurwitz- 

On the other hand, for the case where v = Vu, there is no measurable leader’s 
signal Vm to estimate, the control law ( 1431) reduces to the following special form 


Ui = 

Zi = 


[Kxi K2i]zi, i=l,...,N, 

Ui 3“ Li (y^y 


Ai Ei 

0 S 


[Cm 


Pmj\Zi Off 


(56) 


For this special case, the distributed observer is not needed and the control law is a 
purely decentralized one. 
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7 Some Variants and Extensions 

In this section, we will make some remarks on some variants and extensions of the 
problem studied in this chapter. 


7.1 Multiple leaders and containment control 

The containment control problem involves multiple leaders and the asymptotic 
tracking of the output of followers to a convex hull of the state variables of the 
multiple leaders ini. The problem formulation in Section |4] also includes the con¬ 
tainment control problem as a special case by appropriately interpreting the leader 
system and the tracking error e,. In fact, suppose there are multiple leaders of the 
following form; 


v,=5,v,', i= 1,...,1, (57) 

where, for i= 1 ,... ,1, v/ € K® for some positive integer qo, and I is some integer 
greater than 1. Let Co = {L/=i a,- > 0,Y!i=i (^i = !}■ Then Co is called the 

convex hull of the points vi,..., v/. Let v = col(v'i,..., v/) 

Now define, for i = the output of the subsystem i as y,- = CiXi + DiU, + 

F\iV for some matrix F\i. Denote the reference input of each follower by r = F 2 V 
where 7*2 = (ai,...,«/) 0 Let e,- = y,- — r. Then e, is in the form given in ( l28l l 
with Fi = F\i— F 2 . . Finally, let S = block diag[5'i,...,5/], and Co = ^ 2 . Then the 
multiple leader systems dSTT i can be put in the standard form ( |29] |. 

It can be seen that the objective of making the tracking error e, approach the ori¬ 
gin asymptotically implies the asymptotic convergence of the output of all follower 
subsystems to the convex hull Co. 


7,2 Local exogenous signals versus global exogenous signals 

Another variant of the systems ( l28l l is given as follows 

Xi =AiXi+BiUi + EiVi, 

ymi — Cmi^i F)ffiiUi -f FfjiiVi^ (58) 

ei = CiXi + DiiiiFFiVi, i = 1,..., A, 


where 


Vi = SiVi, ! = 1,...,A, 


(59) 


Title Suppressed Due to Excessive Length 


21 


for some constant matrices Si. This formulation is actually contained in (l28T l by 
defining v = col(vi,... ,vn), and S = block diag[5'i,... ,Sn] and redefining the ma¬ 
trices Ei, F„,i, Fj,i=l,...,N. 


7.3 Synchronized reference generator and the output 
synchronization 


Given maps 4': [0, °o) —K'’ for i = 1 ,..., and a map | ; [0, °°) —>■ K'’, the elements 
of the set ; i = are said to synchronize to ^(•) if lim,^oo(^,(f) — 

^(f)) = 0 for all i = and are said to synchronize if they synchronize to 

some I (•) Il26l . 

Consider the following dynamic compensator 

fj,- = Srii + ^Lo Y. aij{t)Co{rij - 77 ,) , / = 1 ,... (60) 


where S G Co € are some given constant matrices, ^i{t) denote the 

neighbor set of the node i in the graph g > 0 and Fq G are to be 

designed. 

The compensator (l60l) can be obtained from ( |39] | by replacing by .yff(t). 
We assume the graph ^a(t) satisfies the following assumption. 

Assumption 12 There exists a subsequence {4} o/{C * = 0,1,...} with — f/j < 
V for some positive V such that the union graph * ^a{tj) connected. 

Then we have the following result. 

Theorems Under AssumptionUH 

(i) Suppose the graph ^a{t) undirected, S is marginally stable, and the pair (Cq , S) 
is observable. Then, with /d = 1 and Fq = PCq where the matrix P is the unique 
positive definite matrix such that PS^ + SP <0, for any initial condition rjfO), i = 
1 ,..., A, the solution of ll60\l is such that 


lim 

t—¥oo 


rii(,t)-e' 


N 


= 0 


( 61 ) 


exponentially. 

(ii) If Cq = Iq and none of the eigenvalues of S has positive real part, then, with 
Fq = Iq and any p > 0, and any initial condition 77,(0), i = \ , ... ,N, there exists 
some 770 G determined by 7] j{Q), j = \,...,N such that 

lim ( 77 ,( 7 ) 770 ) =0 (62) 

t —Voo ' ' 


exponentially. 
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Remark 18 The proof of Part (i) of Theorem\^can be extracted from the proof of 
Theorem 2 of h22'l . Part (ii) ofTheorem\^was studied in Lemma 1 of h28’i which is 
in turn based on the result in sns. 

Remark 19 If the graph '^a(t) static and connected, and the pair (Co, 5) is de¬ 
tectable, then. Theorem^ can be strengthened as follows. Let A 2 (^) denote the 
smallest positive eigenvalue of the Laplacian matrix of the graph and P be 
the unique positive definite matrix such that SP + PS^ —PC^CoP+Iq < 0. Then, for 
jX > max{ 1, } tind Lq = PCq, the solution ofl \60i is such that 



where r = col{r \,..., r^) S is the unit vector such that r^.Stf = 0. This special 
case of Theorem\^is the direct result of Lemma 1 of l[26]l . 

Remark 20 The special case with p = \, Cq = Iq, and Lq = Iq of the dynamic com¬ 
pensator ( I 6 QD was proposed in h29'i , and was called synchronized reference gen¬ 
erators. Its main difference from the distributed observer ( 139b is that it does not 
contain a feedforward term a, 0 ( 1 ' — 77 ,). If we define a virtual leader v = Sv, and 
let f]i = {rji — v) and fj = col{fji,..., tIn), then, the system (160b can be put in the 
following compact form 


i) = {In(^S- p 0 LoCo)) 77 . (64) 

By Theorem |5] the compensator is not a distributed observer of the virtual leader 
v = Sv because, for i = I,... ,N, the convergence of rji to v happens only if 77 ,( 0 ) 
and v(0) satisfy some equality. As a result, the control law (142b with the distributed 
observer replaced by the synchronized reference generator ( l6Qb will not solve the 
output regulation problem of ( l2(Sb with the exosystem being v = Sv, y„,o = Cqv. Nev¬ 
ertheless, by the same technique as used in the proof of Lemma^ it is possible to 
show that this control law can still make the output yi, i = \ ,... ,N, of H28\l synchro¬ 
nize to a signal of the form 6 * 7)0 /or some fjo determined by 77,(0), i = 1,... ,A^. 


7.4 Discrete distributed observer 

To introduce our problem, let denote the set of nonnegative integers, and '■ 
Z+ — SI’ where = {1,2,. ..,p} is a piecewise constant switching signal in the 
sense that there exists a subsequence U of Z+, called switching instants, such that 
<Jd{t) = P for some pl^ for ti <t < 7,+i for any ti > 0 and all t G Z+. 

Consider the discrete-time counterpart of the linear system (l3^ of the following 
form 


x(t + l) = {lfj®A-pF^^(^i)®{BK))x{t), 7 = 0 , 1 ,..., 00 , 


(65) 
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where A G B G R"^"\ f’a-rf(t) £ R”^" is a piecewise switching matrix, and 

jj. >0 and K G R™^" are to designed. 

Assumption 13 (i) The switching times satisfy f,+ \ — ti > T for some positive integer 
T > 1 for all t,. 

(ii) The matrix is symmetric for all t G and there exists a subsequence 

{4} oflfy with —tij^ < V for some positive V such that all the eigenvalues of 
the matrix ^ positive real parts. 

Let A be the real Jordan form of A, P be the nonsingular matrix such that A = 
P^^AP, and B = PB. Then, we have the following result: 

Lemma 8 Under Assumption [75] suppose all the eigenvalues of A are semi-simple 
with modulus 1, and the pair {A,B) is controllable. Then, with K = B^P^PA, the 
system ( I65l > is asymptotically stable for all p satisfying 

^ ^ ^ - ^^^{\\Fp^iATBBTA)\\] ' 

Remark 21 Lemma\^is taken from Lemma 3.1 of H23]l . As pointed out in Remark 
2.2 of H23]l . the assumption that all the eigenvalues of A are semi-simple with mod¬ 
ulus 1 can be relaxed to the assumption that A is marginally stable, i.e., all the 
eigenvalues of A are inside the unit circle, and those eigenvalues of A with modulus 
1 are semi-simple. 

Now consider a discrete-time linear multi-agent system of the following form: 

Xi{t -1-1) =AiXi{t)-\-BiUi{t)-\-Eiv{t), 

ymi{l) — T Dmi^iil') ( 66 ) 

e,(f) =CiXi{t)+DiUi{t)3-Fiv{t), i= l,...,N, f = 0,1,... , 0 °, 

where x, G R"', ymi € R'’"”', e,- G R''' and «,■ G R'"' are the state, measurement output, 
error output, and input of the ith subsystem, and v G R'^ is the exogenous signal 
generated by a discrete-time exosystem as follows: 

v(f-f 1) =Sv{t), ymo{t) = Cov{t), f = 0 , 1 ,..., 00 , (67) 

where S G R*?^^ is marginally stable. Let be a switching graph associated with 
( l 66 b and dFTb whose weighted adjacency matrix is denoted by ~ 

Define the following dynamic compensator 

77,(f+ 1 ) =577,(f)-f^Lo j ^ a,;(f)Co(t 7 ;(f)-i 7 ;( 0 ) ) : i= ( 68 ) 


where Tjo = v, and the scaler p > 0 and the matrix Lq G are to be designed. 

The system (ibST i is called a discrete distributed observer candidate for v, and is called 
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a discrete distributed observer for v if, for any v( 0 ) and 77 ,( 0 ), 

lim( 77 ,(f)-v(f)) =0, ! = (69) 

t^oo 

Let fji = ( 77 , — v), and 77 = col( 77 i,..., fj/i/). Then, the system (l 68 l l can be put in the 
following compact form 


f7(7 + l)= ((Ijv0S)-/i(Na^(f)0LoCo))fi(t), 7 = 0,l,...,°o. (70) 

Since (giLoCo))^ = *^^ 0*^0 ))’ is not 

difficult to deduce the conditions on various matrices and the graph for guaranteeing 
the stability property of (iTOl i from Lemma[ 8 ] Consequently, the discrete counterparts 
of Theorems |3] and |4] can be obtained. 


7,5 Distributed adaptive observer 


A drawback of the distributed observer (IWt is that the matrix S or Sm is used by 
the controller of every follower. A more realistic controller should only allow those 
followers who are the children of the leader to know the matrix S or Sm- In Gl, 
assuming y„io = v' and Sm = S, a distributed adaptive observer was proposed as fol¬ 
lows; 


N 


Si — ^ a,' j[t)(^Sj Si), i — 1 j ■ ■ ■ ,N, 

7=0 


N 

i]i = SiTii + P 2 Y. - J?;) 

./=o 


(71) 


where 5, € T]i s R^, So = 5 ,770 = v, ^ 1,^2 > 0. 

Moreover, the following result was established in lO 

Lemma 9 Consider the system dZB. Under Assumption |9] suppose all the eigen¬ 
values of the matrix S are semi-simple with zero-real parts. Then, for any /ri,/72 >0 
and for any initial condition 5,(0), 77,(0) and v(0), for i = I,... ,N, Sft) and 77 ,( 7 ) 
exist and are bounded for all t >0, and 

lim(5,(7)-5) = 0, lim( 77 ,( 7 )-v( 7 ))= 0 . (72) 

/—>.00 t-foo 

Remark 22 Lemma^holds for any S if the graph is static and connected. 
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8 Concluding Remarks 


In this chapter, we have presented a unified framework for handling the cooperative 
output regulation problem of multi-agent systems using the distributed observer ap¬ 
proach. The main result not only contains various versions of the cooperative output 
regulation problem for linear multi-agent systems in the literature as special cases, 
but also present a more general distributed observer. We have also simplified the 
proof of the main result by more explicitly utilizing the separation principle and 
the certainty equivalence principle. In summary, we conclude that, as long as a dis¬ 
tributed observer exists, the cooperative output regulation problem of multi-agent 
systems is solvable if and only if the classical output regulation problem of each 
subsystem is solvable by the classical way as summarized in Section 3. 
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Appendix 

Appendix: Graph 

A digraph consists of a finite set of nodes 'f = N} and an 

edge set C y,i ^ j}- An edge from node i to node j is denoted 

by The node i is called the father of the node j and the node j the child of 
the node i. The node i is also called the neighbor of node j. If the digraph con¬ 
tains a sequence of edges of the form (/ 2 ,i 3 ),• • •,( 4 i 4 +i)}> then the set 

{(/i,! 2 ), (/ 2 ,i 3 ( 4 i 4 + 1 )} is called a directed path of from i'l to 4 +i, and 
node 4+1 is said to be reachable from node i'l. A digraph is said to be connected if 
it has a node from which there exists a directed path to every other node. The edge 
{i,j) is called undirected if {i,j) £ S’ implies {j,i) G S. The digraph is called undi¬ 
rected if every edge in S is undirected. A graph = (3^, is called a subgraph of 
‘S = (4^, S)\i'f'sQ'’^ and Ss^SC\ x %). Given a set of r graphs % = (4^, Si), 
i= 1 ,..., r, the graph = [Y , S) with S = IJ/Li is called the union of graphs % 
and is denoted by = IJLi The weighted adjacency matrix sS = of 

is defined as an = 0; for i ^ j, atj > 0 4=> ( 7 ,/) £ S, and a ,7 = aji if the edge {j,i) 
is undirected. The Laplacian of is defined as .if = where la = atj, 

kj = —Qij for i ^ j. To define a switching graph, let = {1,2,..., p } for some pos¬ 
itive integer p. We call a time function <7 : [0, -l-oo) —>-7^ = {l,2,...,p}a piecewise 
constant switching signal if there exists a sequence 4 = 0 < fi < f 2 ,--- satisfy¬ 
ing limi^oob = °° such that, for any k>Q, for all t £ [ 4 , 4 + 1 ), C7(f) = i for some 
i £ Y’. ^ is called the switching index set. Given a piecewise constant switch¬ 
ing signal a : [0,-|-oo) —= { 1 , 2 ,... ,p}, and a set of p graphs = {Y,Si), 
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i = 1,..., p with the corresponding weighted adjacency matrices being denoted by 
i = 1,... ,p, we call a time-varying graph %{t) = ^ switching graph 

with the weighted adjacency matrix if’ for any k >0, for all t G [tk^tk+\), 

’^a[t) = for some i G . 
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